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Abstract 

Students  of  reasoning  have  engaged  In  a vigorous  debate  regarding  the 
representations  and  processes  used  by  subjects  solving  linear  syllogisms. 
Meaningful  communication  between  proponents  of  the  various  positions  has 
been  hampered  by  the  appearance  of  curious  conflicts  In  reported  data  sets 
for  the  linear  syllogism  problems.  The  present  experiment  was  Intended  to 
Isolate  the  source  of  these  conflicts  In  the  literature.  Eighteen  adult 
subjects  received  linear  syllogisms  under  instructions  designed  to  yield 
speeds  commensurate  with  error  rates  of  about  10Z.  Latency  and  error  data 
were  analyzed  both  separately  (via  multiple  regression)  and  Jointly  (via 
canonical  regression).  These  data  were  also  analyzed  via  pseudo-deadlines, 
according  to  which  responses  were  counted  as  correct  If  they  were  correct 
and  fell  below  a given  pseudo-deadline,  and  were  counted  as  erroneous  If 
they  were  Incorrect  or  fell  above  a given  pseudo-deadline.  The  analyses 
revealed  that  the  source  of  the  conflicts  In  the  literature  Is  the  failure 
of  researchers  to  appreciate  the  complex  interrelationships  between  latency 
and  error  rate.  Vhen  these  Interrelationships  are  taken  Into  account,  the 
conflicts  disappear. 
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A Proposed  Resolution  of  Curious  Conflicts 
In  the  Literature  on  Linear  Syllogisms 

In  a linear  syllogism,  an  Individual  Is  presented  with  two  premises, 
each  describing  a relation  between  two  terms.  One  of  the  terms  overlaps 
between  premises.  The  Individual's  task  Is  to  use  this  overlap  to  Infer 
the  relations  among  the  three  terms  of  the  linear  syllogism,  and  then  to 
answer  a question  about  one  or  more  of  these  relations.  A typical  linear 
syllogism  Is 

Jon  Is  taller  than  Bob. 

Sam  la  shorter  than  Bob. 

Who  Is  tallest? 

Psychologists  have  been  Investigating  the  representations  and  processes 
people  use  In  solving  linear  syllogisms  since  Burt's  (1919)  adoption  of 
the  problem  for  one  of  hla  tests  sf  mental  ability.  In  recent  years,  a 
vigorous  debate  has  arisen  regarding  whether  subjects'  representations  of 
the  relations  among  terms  are  spatial  (DeSoto,  London,  & Handel,  1965;  Hutten- 
locher,  1968;  Huttenlocher  & Higgins,  1971),  linguistic  (Clark,  1969a;  Clark, 
1969b),  or  a mixture  of  both  (Sternberg,  Note  1).  Data  recently  collected 
from  four  experiments  In  my  laboratory  make  a strong  case  for  a proposed 
mixture  model  (Sternberg,  Note  1).  These  data  fall  to  resolve  the  debate, 
however,  because  of  surprising  Inconsistencies  across  data  sets  collected  In 
different  laboratories.  In  particular,  whereas  my  own  data  and  those  of 
Potts  and  Scholz  (1975)  and  of  Hunter  (1957)  support  the  mixed  model,  data 
collected  by  Clark  (1969a,  1969b)  and  by  Keating  and  Caramazza  (1975)  support 
a linguistic  model  (see  Sternberg,  Note  1). 
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The  present  paper  seeks  to  resolve  these  inconsistencies,  end  In  so 
doing,  to  advence  our  understsndlng  of  how  linear  syllogisms  sre  solved.  In 
the  next  section  of  the  psper,  the  three  alternative  models  of  linear  ayl- 
loglstic  reasoning  ere  briefly  described.  (A  more  detailed  description  of 
each  BK>del  can  be  found  In  Sternberg,  Note  1.)  Then  possible  sources  of  con- 
flict In  data  testing  these  models  are  described.  Finally,  an  experiment  la 
presented  that  seeks  to  resolve  the  conflicts  regarding  which  model  is  beat. 

The  results  of  the  experiment  may  be  of  Interest  to  experimental  psychologists 
engaged  In  modeling  thought  processes  In  tasks  other  than  linear  syllogisms, 
since  the  results,  call  into  question  our  often  cavalier  ways  of  dealing  (or 
falling  to  deal)  with  the  relationships  between  response  time  end  error  rate. 

MODELS  OF  LINEAR  SYLLOGISTIC  REASONING 

In  this  section  of  the  paper,  three  alternative  models  of  linear  syl- 
logistic reasoning — e spatial  model  (based  upon  the  accounts  of  DeSoto  et 
el.,  1965;  Huttenlocher , 1968;  and  Huttenlocher  & Higgins,  1971),  a lin- 
guistic model  (based  upon  the  account  of  Clark,  1969b),  and  a mixed  model 
(based  upon  the  account  of  Sternberg,  Note  1) — will  be  described  briefly 
and  compared.  An  example  of  a linear  syllogism,  "£  Is  not  as  tall  as  B; 

A Is  not  as  short  as  _B;  Who  Is  shortest?"  will  be  used  to  facilitate  comparison. 
Spatial  Model 

In  the  proposed  spatial  model,  the  terms  of  the  syllogism  are  arranged 
into  an  lmaginal,  linear  spatial  array  that  Is  an  analogue  of  a physical, 
linear  array.  Thus,  the  terms  of  the  example  problem  will  be  arranged  into 
an  Imagined  array  in  which  A Is  at  the  top,  £ Is  In  the  middle,  and  £ Is  at 
the  bottom. 


The  subject  must  first  read  the  terms  of  the  problem.  The  terms  in 
each  premise  are  first  arranged  in  a two-item  array.  The  Initial  arrangement 
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A 

disregards  the  negation.  If  one  la  present.  Thus,  the  first  pair  of  terms 
C B 

Is  arranged  as  g and  the  second  pair  as  A . Arrangement  of  terns  from  the 
top  down  (as  Is  done  when  the  adjective  tall  or  taller  appears  in  the 
premise)  la  easier  and  hence  faster  than  arrangement  of  terms  from  the  bot- 
tom up  (as  Is  done  when  the  adjective  short  or  shorter  appears  In  the 
premise).  Next,  If  a negation  appears  In  a premise,  a new  array  Is  con- 
structed in  which  the  terms  of  the  old  array  are  flipped  around  in  space. 

B A 

In  the  example,  two  new  arrays,  ^ and  g,  are  constructed. 

The  subject  next  attempts  to  Integrate  the  two  arrays.  This  Integra- 
tion will  be  easier  If  the  subject  worked  from  the  ends  of  the  larger  ar- 
ray inward  rather  than  from  the  middle  outward  in  constructing  the  two 
smaller  arrays.  A possible  reason  for  this  directional  effect  Is  that  work- 
ing from  the  ends  inward  brings  one  to  the  pivot,  or  middle  term  of  the  series. 
If  one  ends  up  on  the  middle  term,  then  It  is  Immediately  available  for  use 
as  the  pivot  of  the  larger  array.  If  one  does  not  end  up  on  the  middle  term, 
one  must  search  for  it,  taking  additional  time.  In  an  affirmative  problem, 
this  means  that  the  preferred  order  of  terms  in  a premise  is  the  outermost 
term  followed  by  the  middle  term.  In  a negative  equatlve  problem  (such  as 
the  example  problem),  the  preferred  order  is  reversed,  since  the  flipping 
of  terms  reverses  the  last  term  to  be  encoded  in  working  memory. 

Just  as  it  was  easier  to  work  from  the  top  down  within  each  of  the 
two  two-item  arrays,  it  is  easier  to  work  from  the  top  down  across  the  two 
two-item  arrays,  so  that  processing  is  facilitated  if  the  first  premise  con- 
sists of  the  A and  B>  (top  two)  terms  of  the  array,  rather  than  the  £ and  £ 

terms,  as  in  the  example.  The  subject  Integrates  the  two  arrays  into  a 
A 

single  array,  B,  reads  the  question,  and  then  seeks  the  answer  to  the  ques- 
C 

tion  in  the  array.  In  the  example,  the  correct  answer  is  £. 
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Linguistic  Model 


In  the  proposed  linguistic  model,  the  terms  of  the  syllogism  ere  stored 
by  vay  of  functional  relations  that  represent  the  relation  between  them  at 
the  level  of  linguistic  deep  structure:  (I!  Is  tall*;  C is  tall);  (B  Is  short*; 
A Is  short).  In  the  linguistic  model,  unlike  In  the  spatial  model,  informa- 
tion from  the  tvo  premises  Is  left  unintegrated. 

The  subject  begins  solution  by  encoding  the  surface  structural  strings 
into  linguistic  deep  structures  of  the  kind  shown  above.  Marked  adjectives 
(such  as  short  and  shorter)  are  assumed  to  be  stored  In  more  complex  form 
than  unmarked  adjectives  (such  as  tall  and  taller),  and  hence  are  assumed 
to  cake  longer  to  encode.  The  Initial  encoding  disregards  the  negation,  if 
one  Is  present.  Thus,  the  first  pair  of  terms  Is  arranged  aa  (C  is  tall*; 

B is  tall)  and  (A  Is  short*;  £ is  short).  Upon  encountering  the  negations, 
the  subject  effects  a linguistic  transformation  that  brings  the  propositional 
strings  to  the  form  shown  In  the  preceding  paragraph. 

It  Is  assumed  In  this  model  that  in  order  to  conserve  space  In  working 
memory,  the  encoding  of  the  first  premise  is  compressed,  so  that  only  the 
first  relation,  In  the  example,  (B  Is  tall*),  remains  In  working  memory. 

Since  JB  Is  the  middle  term,  the  pivot  of  the  three-item  relation  is  retained 
In  working  memory,  and  locating  It  does  not  present  a problem.  But  If  the 
first  premise  had  been  "B  Is  not  as  short  as  £,"  only  (£  Is  short*)  would  have 
been  retained  In  working  memory,  resulting  in  the  subject's  needing  to  search 
long-term  memory  for  the  missing  pivot  term  (B) . This  search  for  the  pivot 
consumes  additional  time. 

Having  found  the  pivot,  the  subjects  reads  the  question.  If  the  question 


contains  a marked  adjective,  additional  time  is  spent  encoding  it.  In  the 
example,  the  subject  seeks  the  Individual  who  Is  shortest.  All  propositional 
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information  Is  now  made  available  for  the  final  search.  Solving  the  problem 
requires  finding  the  individual  who  is  ehort+  relative  to  the  pivot,  but  no 
such  individual  is  found  in  the  example.  The  reason  no  such  individual  is 
found  is  that  the  form  of  the  question  is  incongruent  with  the  way  in  which 
the  answer  term  has  been  encoded.  Whereas  the  shortest  term,  C,  was  previ- 
ously encoded  as  tall  (relative  to  the  tall+JS),  the  question  asks  for  the 
person  who  is  shortest.  The  subject  must  therefore  make  the  question  con- 
gruent with  the  problem  terms  as  encoded.  He  or  she  does  so  by  looking  for 
the  least  tall  individual — someone  is  tall-  relative  to  a tall  pivot,  or 
tall  relative  to  a tall+  pivot.  The  subject  can  now  respond  with  the  cor- 
rect answer,  C. 

Linguistic-Spatial  Mixed  Model 

In  the  proposed  mixed  model,  the  terms  of  the  syllogism  are  first  de- 
coded into  linguistic  deep-structural  propositions  (as  in  the  linguistic 
model),  and  are  then  encoded  into  spatial  arrays  (as  in  the  spatial  model). 

However,  the  mixed  model  Involves  only  a subset  of  the  processes  used  in  the 
spatial  and  linguistic  models,  and  adds  some  processes  appearing  in  neither 
of  the  other  two  models. 

The  subject  begins  solution  by  decoding  the  surface-structural  strings 
into  linguistic  deep  structures.  These  linguistic  deep  structures  then  form 
the  basis  for  the  construction  of  spatial  arrays,  one  for  each  premise.  Marked 
adjectives  are  assumed  to  increase  processing  time,  both  through  increased  lin- 
guistic decoding  time  and  through  Increased  spatial  encoding  time.  Negations 
are  handled  as  in  the  spatial  model,  with  new  arrays  constructed  from  the 
original  arrays  by  flipping  the  elements  of  the  original  arrays  in  space. 


In  order  for  the  subject  to  combine  the  terms  of  the  premises  into  a 
single  spatial  array,  the  subject  needs  the  pivot  available.  The  pivot  is 
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either  Immediately  available  from  the  spatial  encoding  of  the  premises,  or 
else  It  must  be  located.  The  pivot  Is  Immediately  available  In  all  (a)  af- 
firmative problems  and  (b)  negative  equatlve  problems  In  which  the  second 
premise  begins  with  the  pivot  (see  Sternberg,  NCe  1,  for  a description  of 
the  mechanism  of  pivot  search).  In  the  example  problem,  the  second  nega- 
tive equatlve  premise  does  not  begin  with  the  pivot,  but  with  an  end  term, 
so  that  the  pivot  must  be  located  as  the  term  that  overlaps  between  the 
two  two-item  spatial  arrays.  Once  the  pivot  has  been  located,  the  sub- 
ject seriates  the  terms  from  the  two  two-item  spatial  arrays  Into  a single 
three-item  spatial  array.  In  forming  the  array,  the  subject  starts  with 
the  terms  of  the  first  premise,  and  ends  with  those  of  the  second  premise. 

The  subject's  mental  location  after  seriation,  therefore.  Is  in  that  half  of 
the  array  described  by  the  second  premise  (which  Is  the  top  half  in  the  example) . 
The  subject  next  reads  the  question.  If  there  Is  a marked  adjective  In 
the  question,  the  subject  will  take  longer  to  decode  the  adjective  linguis- 
tically, and  to  seek  the  response  to  the  problem  at  the  nonpreferred  (usually 
bottom)  end  of  the  array.  The  response  may  or  may  not  be  Immediately  available. 
If  the  correct  answer  is  in  the  half  of  the  array  where  the  subject  just 
completed  seriation  (his  or  her  active  location  in  the  array),  then  the  re- 
sponse will  be  Immediately  available.  If  the  question  requires  an  answer 
from  the  other  half  of  the  array,  however,  the  subject  will  have  to  search 
for  the  response,  mentally  traversing  the  array  from  one  half  to  the  other 
and  thereby  consuming  additional  time.  In  the  example,  the  subject  ends  up 
In  the  top  half  of  the  array,  but  Is  asked  a question  about  the  bottom  half  of 
the  array  ("Uho  is  shortest?"),  requiring  search  for  the  response. 

Under  certain  circumstances  (see  Sternberg,  Note  1),  the  subject  checks 
the  linguistic  form  of  the  proposed  response  against  the  form  of  the  adjective 
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in  the  question.  If  the  two  forms  sre  congruent,  the  subject  responds  with 
the  designated  answer.  If  not,  the  subject  first  makes  sure  that  congruence 
can  be  established,  and  then  responds.  In  the  example,  congruence  must  be 
established,  since  the  shortest  term,  C,  has  previously  been  decoded  in  terms 
of  the  adjective  tall.  Once  congruence  has  been  established,  £ can  be 
recognized  as  the  correct  answer  to  the  example  problem. 

Summary 

The  models  all  agree  that  some  form  of  encoding,  negation,  marking,  and 
response  contribute  to  response  latency,  and  although  the  models  in  some  cases 
disagree  as  to  the  exact  form  each  operation  takes,  mathematical  parameters 
corresponding  to  the  durations  of  these  operations  are  estimated  from  the 
same  independent  variables . for  each  model.  Each  model  also  contains  a pivot 
search  operation,  although  the  parameter  corresponding  to  the  duration  of  this 
operation  is  estimated  in  a different  way  for  each  model.  The  spatial  model 
further  contains  a premise  order  parameter,  and  the  mixed  model  further  con- 
tains a response  search  parameter.  The  linguistic  model  further  contains  a 
noncongruence  parameter,  which  appears  only  under  special  circumstances  in 
the  mixed  model  (Including  the  circumstances  of  the  experiment  to  be  described 
in  this  report). 

CONFLICTS  IN  DATA  SETS  TESTING  THE  MODELS 

The  data  from  previous  research  reveal  curious  conflicts.  Except  for 
the  data  set  of  Clark  (1969b), * the  data  sets  appear  to  be  reliable,  and  so 
the  inconsistencies  among  data  sets  seem  likely  to  be  due  to  factors  other 
than  chance.  What  factor  or  factors  might  be  responsible  for  the  inconsistencies? 
Two  possibilities  are  considered  in  this  article.  First,  there  may  be  a dif- 
ference in  speed-accuracy  tradeoff  between  subjects  in  the  experiments  supporting 
the  mixed  model  and  subjects  in  the  experiments  supporting  the  linguistic  model. 


* 
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The  error  rate  in  each  of  the  Sternberg  (Note  1)  experiments  was  1Z;  in  the 
Potts  and  Scholz  (1975)  experiment  (Experiment  1,  Group  1),  the  error  rate 
was  7Z;  Hunter  (1957)  did  not  report  error  rates.  The  error  rate  in  the  Clark 
(1969b)  experiment  was  7Z;  it  was  30Z  In  the  Clark  (1969a)  experiment,  and  22Z 
in  the  Keating  and  Caramazza  (1975)  experiment.  These  last  two  experiments 
used  a procedure  different  from  that  of  the  other  experiments,  where  standard 
latency  measurements  for  solving  Individual  items  were  taken.  In  these  two  ex- 
periments, subjects  were  given  10  seconds  to  solve  each  problem.  An  error 
was  counted  if  the  subject  either  responded  incorrectly  or  failed  to  respond 
at  all  in  the  10  seconds.  The  deadline  procedure  used  by  Clark  (1969a)  and 
by  Keating  and  Caramazza  (1975)  would  seem  to  encourage  subjects  to  emphasize 
speed  at  the  expense  of  accuracy,  since  any  response  taking  longer  than  10 
seconds,  whether  right  or  wrong,  was  counted  as  an  error.  Support  in  these 
experiments  for  the  linguistic  model  may  thus  have  been  due  to  the  higher 
error  rates  obtained.  Second,  the  procedure  used  in  these  two  experiments 
may  itself  have  been  responsible  for  the  conflicts  in  the  data.  If  we  ignore 
the  probably  unreliable  data  of  Clark  (1969b),  we  find  that  data  obtained  under 
standard  response-time  procedures  tend  to  support  the  mixed  model,  whereas  data 
obtained  under  the  deadline  procedure  tend  to  support  the  linguistic  model. 

If  experimental  procedure  is  the  factor  responsible  for  the  difference  in 
model  fits,  then  two  subfactors  need  to  be  distinguished.  First,  the  use  of 
a deadline  may  in  and  of  itself  lead  to  a linguistic  strategy.  Second,  the 
modeling  of  errors  (in  the  deadline  procedure)  rather  than  latencies  (in  the 
standard  procedure)  may  lead  to  the  apparent  superiority  of  the  linguistic  model. 
The  research  to  be  described  was  intended  to  distinguish  among  these  possible 
explanations  of  the  conflicts  among  data  sets. 
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A single  experiment  proved  sufficient  to  distinguish  among  the  hypoth- 
eses considered  above  regarding  the  conflicts  among  data  sets,  and  to  dia- 
cover  the  responsible  factor.  In  this  experiment,  subjects  solved  linear 
syllogisms  under  the  standard  conditions,  with  as  long  as  they  needed  to 
solve  each  Item.  However,  subjects  were  strongly  encouraged  to  solve  Items 
as  rapidly  as  they  could,  and  a bonus  was  paid  to  reward  fast  performance 
accompanied  by  only  a moderate  degree  of  accuracy. 

Method 


Subjects 

Subjects  were  18  undergraduates  attending  the  Yale  summer  term.  Of  these 
subjects,  10  were  women  and  8 were  men. 

Materials 

Stimuli  were  two-term  series  problems  and  three-term  series  problems 
(linear  syllogisms).  The  32  types  of  three-term  series  problems  varied  dl- 
chotomously  along  five  dimensions:  (a)  whether  the  first  premise  adjective 
was  marked  or  unmarked;  (b)  whether  the  second  premise  adjective  was  marked 
or  unmarked;  (c)  whether  the  question  adjective  was  marked  or  unmarked;  (d) 
whether  the  premises  were  affirmative  or  negative;  (e)  whether  the  correct 
answer  was  in  the  first  or  second  premise.  The  8 types  of  two-terra  series 
problems  varied  dichotomously  along  three  dimensions:  (a)  whether  the  premise 
adjective  was  marked  or  unmarked;  (b)  whether  the  question  adjective  was 
marked  or  unmarked;  (c)  whether  the  premise  was  affirmative  or  negative.  There 
were  three  replications  of  each  item  type,  one  using  the  adjective  pair 
taller-shorter,  one  using  the  adjective  pair  better- worse,  and  one  using  the 
adjective  pair  faster-slower. 

Apparatus 


Two-  and  three-term  series  problems  were  administered  via  a Gerbrands  two 
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field  tachlstoscope  with  an  attached  centlaecond  clock. 

Design 

The  design  of  the  experiment  was  completely  wlthln-subject:  Each  subject 
received  each  Item  type  three  times,  once  with  each  adjective.  The  dependent 
measures  of  Interest  were  response  time  and  error  rate. 


Procedure 

Subjects  were  first  a. .own  examples  of  typical  two-  and  three-term  series 
problems,  and  were  told  that  their  taak  was  to  solve  items  of  these  types. 
These  items,  and  the  practice  ltema  given  later,  used  the  adjective  pair 
older-younger,  which  was  not  used  In  the  actual  test  items.  Instructions  to 
subjects  Indicated  that  the  subjecta  should  solve  problems  at  a rate  that 
would  allow  about  10Z  errors,  and  that  a monetary  bonus  would  be  paid  for 
fast  performance  at  an  error  rate  of  about  10Z.  In  fact,  the  bonus  was  com- 
puted strictly  on  the  basis  of  error  rate.  A bonus  of  50c  was  paid  for  four 
errors  (out  of  40  items),  35c  for  three  or  five  errors,  15c  for  two  or  six 
errors,  10c  for  one  or  seven  errors,  and  0c  for  zero  or  eight  or  more  errors. 
Subjects  were  told  after  each  third  of  the  items  was  completed  what  their 
bonus  for  the  preceding  40  items  was,  and  what  their  maximum  bonus  could  have 
been  (50c).  Subjects  were  then  told  to  speed  up  if  their  error  rate  was  under 
10Z,  or  to  slow  down  if  their  error  rate  was  over  10Z. 

All  testing  was  done  in  one  session.  Testing  began  with  the  administra- 
tion of  eight  practice  items.  Next,  subjects  received  120  stimulus  items. 
Items  were  blocked  by  number  of  terms  (two  or  three)  and  by  adjective  pair 
(taller-shorter,  better-worse,  faster-slower) , with  order  of  blocks  counter- 
balanced across  subjecta. 
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Results 

The  results  of  the  experiment  will  be  presented  in  four  parts.  In  the 
first,  the  success  of  the  speed-accuracy  tradeoff  manipulation  will  be  evalu- 
ated. In  the  second,  comparability  of  the  present  data  aet  to  previous  ones, 
as  measured  by  standard  data-analytlc  techniques,  will  be  assessed.  In  the 
third,  latency  and  error  data  will  be  analyzed  as  though  various  deadlines 
had  been  used  In  presenting  the  stimulus  Items.  The  data  will  be  partitioned 
on  the  bases  of  pseudo-deadlines  of  2,  4,  6,  8,  10,  12,  14,  16,  and  • seconds. 

In  the  fourth,  the  latency  and  error  data  will  be  considered  simultaneously 
as  joint  dependent  variables.  This  analysis  will  show  the  serious  consequences 
of  falling  to  take  into  account  both  solution  latency  and  error  rate,  as  well 
as  the  relationships  between  them. 

Success  of  the  Speed-Accuracy  Tradeoff  Manipulation 

The  first  issue  that  needs  to  be  addressed  Is  whether  the  speed-accuracy 
tradeoff  manipulation  in  the  instructions  to  subjects  was  successful.  The 
mean  solution  latency  for  the  three-term  series  problems  in  this  experiment 
was  5922  + 128  msec.  Respective  means  for  Experiments  1-4  of  Sternberg  (Note  1) 
were  7285  + 177  msec,  7489  + 188  msec,  7002  + 370  msec,  and  7069  + 161  msec. 

The  mean  response  time  In  the  present  experiment  was  therefore  more  than  one 
second  faster  than  the  mean  response  time  In  any  of  the  earlier  experiments. 
Indicating  that  the  instructions  in  the  present  experiment  were  successful  in 
speeding  subjects  up.  The  mean  error  rate  in  the  present  experiment  was  7Z, 
compared  to  1Z  in  each  of  the  earlier  experiments,  indicating  that  the  instruc- 
tions were  also  successful  In  increasing  error  rates.  The  speed-accuracy 
tradeoff  manipulation  may  therefore  be  viewed  as  having  succeeded. 

Comparability  of  Present  Data  to  Previous  Data 


Intercorrelations  of  data  sets.  The  present  data  aet  is  highly  similar 


Proposed  Resolution 
13 

to  those  presented  In  Sternberg  (Note  1).  The  median  Intercorrelation  across 

data  sets  from  the  four  experiments  presented  in  Sternberg  (Note  1)  vas  .84, 

whereas  the  median  intercorrelation  between  the  present  data  set  and  these 

four  previous  data  sets  vas  .86.  Since  the  split-halves  reliability  of  the 

2 

present  data  set  vas  also  .86,  and  since  the  previous  data  had  a median  split- 
halves  reliability  of  .89,  the  correlations  between  the  present  and  previous 
data  sets  were  about  as  high  as  the  reliabilities  of  the  data  vould  allow. 

Qualitative  fits  of  the  models  to  the  latency  data.  Five-way  analyses 
of  variance  were  conducted  on  the  observed  solution  latencies  and  on  the 
predicted  solution  latencies  for  each  model.  The  five  factors  in  the  analyses 
were  the  same  ones  that  generated  the  2^  ■ 32  linear  syllogism  types  in  the 
experiment  (see  Materials  section).  Each  cell  of  the  2^  design  contained  three 
observations,  namely,  the  means  over  subjects  of  the  solution  latencies  for 
a given  adjective  pair. 

The  results  of  the  analyses  of  variance  replicated  those  of  Sternberg 
(Note  1).  The  major  findings  were  these: 

1.  The  effect  of  marked  adjectives  vas  highly  significant  for  both 
premises,  F(l,64)  - 47.95,  £<.001  for  premise  1 and  £(1,64)  ■ 7.83,  £<.01 

for  premise  2,  but  only  marginally  significant  for  the  question,  F(l,64)  ■ 3.63, 
£<.10.  All  three  models  predicted  a marking  effect  of  35  csec  for  both  premises 
and  question,  although  the  observed  effects  were  63,  25,  and  17  csec  respectively. 
The  models  were  therefore  successful  in  predicting  an  effect,  but  unsuccessful 
in  predicting  the  differential  effect  of  where  the  marked  adjective  occurred. 

2.  The  observed  effect  of  negation,  65  csec  for  the  two  premises  combined, 
was  highly  significant,  F(l,64)  - 50.75,  £<.001,  and  equal  in  magnitude  to 

the  effect  predicted  by  each  of  the  three  models. 

3.  Items  with  the  correct  answer  in  the  first  premise  were  significantly 
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herder  then  Items  with  the  correct  enswer  In  the  second  premise,  F(l,64)  • 28.28, 

£ <.001.  The  mixed  model  correctly  predicted  this  effect  end  Its  duretlon,  49 

csec.  This  letency  reflects  the  need  of  the  subject  to  seerch  for  the  response 

In  Items  vhere  the  response  Is  not  Immediately  available.  The  linguistic  and 

apatlal  models,  lacking  a response  search  operation,  failed  to  predict  this  effect. 

4.  The  observed  data  showed  five  statistically  significant  Interactions. 

The  mixed  model  correctly  predicted  four,  the  linguistic  model,  three,  and  the 

spatial  model,  two  of  these  Interactions.  The  mixed  and  spatial  models  each 

predicted  one  spurious  Interaction;  the  linguistic  model  predicted  two. 

Quantitative  fits  of  the  models  to  the  latency  data.  Each  of  the  three 

models  was  fit  separately  to  group  latency  data  for  three-term  series  problems 

only,  for  two-  and  three-term  series  problems  together,  and  for  three-term 

series  problems  for  each  adjective  considered  separately.  Table  1 shows  the 

2 

means  and  standard  errors  of  the  latency  data,  plus  the  values  of  R obtained 

In  predicting  the  latency  data  from  the  Independent  variablea  specified  by 

each  of  the  three  models  (and  described  in  detail  In  Sternberg,  Note  1).  The 
2 

higher  values  of  R for  the  two-  and  three-term  series  problems  in  combination 
are  due  to  the  separation  of  the  encoding  component  In  these  analyses;  this 
component  is  confounded  with  the  response  component  In  the  analyses  of  three- 
term  series  problems  only.  In  general,  the  results  closely  replicate  those 
of  Sternberg  (Note  1),  except  for  the  faster  latencies  obtained  due  to  the 
speed-acouracy  tradeoff  manipulation. 

Insert  Table  1 about  here 

The  mixed  model  performed  considerably  better  than  did  either  the  llnguis- 

2 

tic  or  spatial  model:  The  value  of  R for  the  mixed  model  was  .251  higher  than 
that  for  the  linguistic  model,  and  .237  higher  than  that  for  the  spatial  model. 
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Even  with  the  optional  noncongruence  parameter  deleted,  R for  the  mixed  model, 

.761,  vas  still  .155  better  than  that  for  the  next  best  model.  Deletion  of 
this  parameter  Is  of  doubtful  theoretical  justification,  however,  since  the 
mixed  model  specifies  that  the  full  set  of  parameters  Is  necessary  to  account 
for  subjects'  performance  under  these  circumstances  (see  Sternberg,  Note  1). 

Each  subject's  data  vas  also  analyzed  Individually,  and  the  results  of  the 
Individual  model  fitting  also  supported  the  mixed  model.  Although  the  mixed 
model  Is  superior  to  the  alternative  models.  It  Is  not  the  true  model:  The 
residual  variance  was  highly  significant  (£<.001),  Indicating  that  systematic 

3 

variance  vas  still  left  unaccounted  for. 

Although  the  present  data  set  la  highly  correlated  with  the  preceding 
(Sternberg,  Note  1)  data  sets,  leading  to  comparable  patterns  of  model  fits, 
there  was  a large  difference  between  mean  latencies  in  the  present  versus  the 
preceding  tasks.  By  decomposing  response  time  Into  components,  and  then  com- 
paring latency  parameter  estimates  across  data  sets.  It  Is  possible  to  localize 
the  effect  of  the  speed-accuracy  tradeoff  manipulation  upon  information  processing. 
Table  2 presents  parameter  estimates  from  the  present  experiment  and  two  previous 
experiments  (from  Sternberg,  Note  1)  that  were  highly  comparable  to  the  present 
experiment  except  for  the  emphasis  upon  accuracy  In  the  Instructions.  A corn- 

insert  Table  2 about  here 

pariaon  of  the  parameter  estimates  for  the  various  experiments  shows  a general 
decrease  In  the  latencies  of  the  various  component  processes  under  the  speed 
condition.  But  the  decrease  is  not  uniform:  It  is  due  primarily  to  more  rapid 
encoding,  that  Is,  construction  of  the  spatial  array  showing  the  relationships 
among  terms  of  the  problem.  Rapid  construction  of  this  array  would  seem  likely 
to  Increase  subjects'  susceptibility  to  errors,  and  Indeed,  a decrease  in  overall 
latency  of  one  second  was  bought  at  the  cost  of  a seven-fold  Increase  In  error  rate. 
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So  far,  the  data  have  not  revealed  why  the  linguistic  model  performs 
better  than  the  mixed  model  under  certain  circumstances.  They  have  shown, 
however,  that  the  difference  in  model  performance  cannot  be  attributed  merely 
to  a difference  between  speed-accuracy  tradeoff  conditions  In  the  various  ex- 
periments. The  first  suggested  explanation  of  the  conflict  among  data  sets 
in  the  literature  on  linear  syllogisms  Is  therefore  shown  to  be  Incorrect. 
Reanalysls  of  Data  with  Pseudo-Deadlines 

The  second  suggested  explanation  of  the  conflict  in  the  literature  was 
based  upon  the  use  of  a deadline  procedure  In  the  reliable  data  sets  supporting 
the  linguistic  model,  but  of  a standard  unlimited-time  procedure  in  the  reliable 


data  sets  supporting  the  mixed  model:  The  difference  In  relative  model  fits 
might  be  due  to  a difference  In  procedures.  Ideally,  one  would  want  to  test 
this  hypothesis  by  testing  multiple  groups  of  subjects  under  various  deadlines. 

The  limiting  case  of  these  deadlines  would  be  infinite  time,  which  would  be 
equivalent  to  the  standard  unlimited-time  procedure.  An  experiment  with  a 
large  number  of  different  deadlines  Is  Impractical,  however.  An  exploratory 
procedure  was  therefore  used  in  which  the  data  were  partitioned  by  means  of 
pseudo-deadlines.  In  this  procedure,  the  data  were  reanalyzed  as  If  each  of  a 
sequence  of  Increasing  deadlines  had  been  used.  As  a first  pseudo-deadline,  all 
correct  responses  with  latencies  of  two  seconds  or  less  were  counted  as  "corrects;" 
all  error  responses  and  responses  with  latencies  of  over  two  seconds  were  counted 
as  "errors."  The  pseduo-deadllne  procedure  was  then  repeated  for  simulated  dead- 
lines of  4,  6,  8,  10,  12,  14,  16,  and  • seconds.  In  this  last  case,  only  genuine 
error  responses  were  treated  as  errors,  since,  of  course,  all  latencies  were  finite. 

Error  rates.  Means  and  standard  errors  of  the  proportions  of  errors,  as 
well  as  fits  of  the  models  to  proportions  of  errors,  are  shown  in  Table  3. 

Modeling  of  logarithms  of  numbers  of  correct  responses  yielded  comparable  results. 


/ 
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Keep  in  mind  that  In  the  present  Method  of  analysis,  each  subject  receives  a 
score  of  0 (correct)  or  1 (error)  on  a given  item;  the  data  become  approximately 
continuous  only  when  averaged  across  subjects. 

Insert  Table  3 about  here 


The  data  reveal  a most  interesting  pattern:  For  pseudo-deadlines  of  under 
10  seconds,  the  performance  of  the  mixed  model  is  clearly  superior  to  the  per- 
formance of  any  of  the  other  models.  At  10  seconds,  however,  the  relative  per- 
formances of  the  models  change  dramatically.  Although  the  predictive  power  of 
all  the  models  is  reduced,  the  predictive  power  of  the  mixed  model  is  reduced 
to  a far  greater  extent  than  that  of  either  of  the  other  two  models.  The  lin- 
guistic model  now  becomes  slightly  superior  to  the  mixed  model,  and  this  superi- 
ority holds  up  at  14,  16,  and  • seconds  (where  only  genuine  error  responses  are 
modeled).  Thus,  a cutoff  of  10  seconds,  that  which  happened  to  have  been  used 
by  Clark  (1969a)  and  by  Keating  and  Caramazza  (1975),  turns  out  to  be  a crossing 
point  in  the  relative  performances  of  the  mixed  and  linguistic  models.  At  this 
cutoff,  there  is  a sharp  decrease  in  the  variance  of  error  rates  across  items 
(as  can  be  Inferred  from  the  large  drop  in  standard  error  as  shown  in  the  table) , 
and  only  13Z  of  the  responses  are  being  counted  as  errors.  It  therefore  appears 
that  the  interpretation  and  modeling  of  error  rates  from  the  deadline  (or  pseudo- 
deadline)  procedure  is  somehow  responsible  for  the  crossover  in  relative  model 
fits,  although  the  mechanism  behind  the  crossover  remains  to  be  explained. 

Some  understanding  of  why  the  crossover  happens  can  be  gleaned  by  examining 
the  standardized  regression  coefficients  (beta  weights)  for  each  of  the  parameters 
of  each  model  at  the  various  pseudo-deadlines.  These  coefficients  are  shown  in 
Table  4.  In  order  to  provide  a baseline  for  comparison,  standardized  regression 
coefficients  are  also  shown  for  response  times  as  modeled  in  the  preceding  section 


of  this  article 
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Insert  Table  4 about  here 

Consider  first  the  standardised  coefficients  for  the  mixed  model.  All 

coefficients  were  statistically  significant  In  predicting  response  tines,  but 

not  in  predicting  error  rates  as  analyzed  under  the  pseudo-deadline  procedure. 

In  particular,  the  coefficients  for  pivot  search  and  response  search,  the 

two  parameters  unique  to  the  mixed  model,  were  statistically  significant 

up  to  8 seconds,  but  were  nonsignificant  thereafter  (except  for  pivot  search 

at  12  seconds).  The  standardized  coefficient  for  noncongruence  also  started 

off  significant  and  became  nonsignificant,  although  not  until  a pseudo-deadline 

2 

of  16  seconds.  The  steep  decrease  In  R for  the  mixed  model  at  10  seconds  can 
thus  be  understood  In  terms  of  the  failure  of  pivot  search  and  response  search 
to  distinguish  between  "correct"  and  "error"  responses  at  this  and  subsequent 
pseudo-deadlines . 

Consider  next  the  standardized  coefficients  for  the  linguistic  model. 

Of  greatest  interest  was  the  pattern  of  coefficients  for  linguistic  pivot  search. 
This  parameter  did  not  contribute  significantly  to  prediction  of  response  time, 
but  It  did  contribute  significantly  to  prediction  of  error  rates  from  the  6 
second  cutoff  to  the  cutoff  of  • seconds.  This  pattern  of  significant  pre- 
diction of  error  rate  coupled  with  nonsignificant  prediction  of  response  time 
Is  most  unusual,  since  response  time  is  often  viewed  as  a more  sensitive  measure 
of  the  same  thing  measured  by  error  rate.  Discussion  of  this  unusual  finding 
will  be  deferred  until  later.  The  pattern  of  loadings  Indicates  that  the  drop 
In  predictive  power  of  the  linguistic  model  at  10  seconds  Is  attributable  to 
only  a single  parameter,  negation,  as  opposed  to  two  parameters,  pivot  search 
and  response  search.  In  the  mixed  model.  It  is  therefore  not  surprising  that 
the  drop  for  the  linguistic  model  was  smaller  than  that  for  the  mixed  model. 
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Finally,  consider  the  standardized  coefficients  for  the  spatial  model. 

An  examination  of  these  coefficients  reveals  that  the  drop  In  predictive  pover 
at  10  seconds  Is  due  to  the  reduction  In  predictive  pover  of  the  negstlon  parameter, 
as  In  the  linguistic  model. 

To  summarise,  the  analyses  of  error  rates  modeled  under  the  pseudo-deadline 
procedure  show  that  the  linguistic  model  becomes  superior  to  the  mixed  model 
In  predictive  pover  vhen  the  variance  across  Items  In  error  rates  becomes  very 
small.  In  the  present  data  (and  very  likely  In  previous  data  as  veil),  a sharp 
decrease  in  variance  occurs  at  a pseudo-deadline  of  10  seconds.  At  this  point, 
only  13Z  of  responses  are  cotinted  as  errors.  Both  the  mixed  and  linguistic  models 
shov  decreases  In  predictive  pover  at  the  10  second  cutoff,  but  the  decrease  Is 
much  more  pronounced  for  the  mixed  model  than  for  the  linguistic  model.  This 
is  because  two  parameters  In  the  mixed  model — pivot  search  and  response  search — 
become  useless  In  predicting  errors  at  this  point.  In  the  linguistic  model,  only 
negation  loses  Its  predictive  pover  at  this  point. 

Response  times.  The  analyses  presented  above  suggest  that  something  about 
the  deadline  or  pseudo-deadline  procedures  leads  to  conclusions  different  from 
those  dravn  vhen  standard  unlimited-time  procedures  are  used.  It  Is  not  clear 
yet,  hovever,  vhat  this  ''something''  is.  As  noted  earlier,  it  may  be  the  deadline 
or  pseudo-deadline  procedures  themselves;  or  It  may  be  the  modeling  of  error 
data.  Irrespective  of  the  use  or  nonuse  of  deadlines  or  pseudo-deadlines.  Note 
In  this  regard  that  modeling  of  error  rates  In  the  limiting  pseudo-deadline 
condition  (•  seconds)  results  in  superior  prediction  for  the  linguistic  model 
over  the  mixed  model.  In  order  to  distinguish  betveen  these  tvo  possibilities, 
each  of  the  three  models  vas  fit  to  latency  data  analyzed  via  pseudo-deadlines. 

In  one  set  of  analyses,  the  models  vere  fit  to  latencies  above  each  of  the  pseudo- 
deadlines.  Latencies  below  the  cutoffs  vere  treated  as  missing  data.  In  a 
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second  set  of  anilyses,  the  models  were  fit  to  latencies  below  each  of  the 
pseudo-deadlines.  Latencies  above  the  cutoffs  were  trested  as  missing  data. 

If  the  mere  use  of  pseudo-deadlines  (or  deadlines)  accounts  for  the  con- 
flicts In  the  data,  then  the  mixed  model  should  perform  better  than  the  linguis- 
tic model  at  some  cutoffs  but  not  at  others.  If,  however,  it  Is  modeling  of 
error  data  that  is  responsible  for  the  conflicts,  then  the  mixed  model  should 
be  superior  to  the  linguistic  model,  irrespective  of  the  particular  cutoff  used. 

Means,  standard  errors,  and  model  fits  for  latencies  above  and  below  the 
cutoffs  are  shown  In  Table  5.  Note  that  not  every  Item  type  had  any  observations 
above  or  below  every  possible  pseudo-deadline.  For  example,  only  13  of  the  32 
Item  types  had  any  observations  with  latencies  of  greater  than  14  seconds;  no 
item  types  had  any  observations  with  latencies  of  less  than  2 seconds.  The  ln- 

Insert  Table  5 about  here 

terpretatlon  of  the  data  In  Table  5 Is  unequivocal.  For  all  pseudo-deadlines 
under  or  over  which  there  was  statistically  significant  prediction,  the  mixed 
model  was  clearly  superior  to  either  the  linguistic  or  spatial  model.  Thus,  It 
was  not  the  use  of  deadlines  per  se  that  resulted  in  the  superiority  of  the 
linguistic  model:  If  latencies  are  modeled  under  the  pseudo-deadline  procedure, 
the  mixed  model  is  always  better.  Rather,  it  was  the  use  of  error  rate  as  a 
basis  for  modeling  that  resulted  in  the  conflict.  The  mixed  model  better  pre- 
dicts latencies;  the  linguistic  model  better  predicts  error  rates.  The  probable 
reason  for  the  crossover  in  performance  of  the  models  at  the  10  second  cutoff 
is  that  at  this  point,  almost  all  of  the  countable  errors  were  actual  errors 
rather  than  long  solution  latencies. 
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Modeling  of  Latency  and  Error  Data  Simultaneously 

Model  fitting  by  canonical  regression.  The  analyses  described  above 
suggest  that  complete  understanding  of  linear  syllogistic  reasoning  requires 
simultaneous  consideration  of  both  solution  latency  and  error  rate  as  de- 
pendent variables.  This  simultaneous  analysis  was  done  here  by  canonical 
regression  (Cooley  & Lohnes,  1971;  Sternberg,  1977b;  Tatsuoka,  1971).  In 
the  present  use  of  canonical  regression,  solution  latency  and  error  rate  were 
considered  jointly  as  dependent  variables,  with  the  Independent  variables  the 
same  as  in  each  of  the  modela  as  previously  described.  Canonical  weights 
(analogous  to  beta  weights  In  regression)  are  derived  by  least  squares  for 
each  dependent  and  independent  variable  to  maximize  the  canonical  correlation 
between  the  two  sets  of  variables.  As  in  factor  analysis  (but  not  in  simple 
or  multiple  regression),  it  is  possible  to  have  more  than  one  set  of  weights, 
with  each  subsequent  set  of  weights  orthogonal  to  all  previous  ones  and  de- 
scribing different  aspects  of  the  relationship  between  dependent  and  indepen- 
dent variables. 

Mixed,  linguistic,  and  spatial  canonical  models.  Table  6 shows  the  fits 
of  the  mixed,  linguistic,  and  spatial  canonical  models  to  the  latency  and  error 
data,  as  well  as  the  standardized  parameter  estimates  (canonical  weights)  for 
each  of  the  dependent  and  independent  variables. 

Insert  Table  6 about  here 

The  first  canonical  variate  was  statistically  significant  for  each  model. 

The  mixed  model  clearly  gave  the  best  account  of  the  first  canonical  variate. 

2 

Indeed,  the  value  of  canonical  R for  the  mixed  model,  .849,  was  only  trivially 

2 

higher  than  the  value  of  multiple  R for  the  mixed  model  (for  latencies  con- 

2 

sldered  alone),  .843  (see  Table  1).  The  increments  in  R for  the  other  models 
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were  also  trivially  small.  The  standardized  parameter  estimates  for  the 
dependent  variables  on  the  first  variate  reveal  that  solution  latency  was  the 
main  contributor  to  the  variate,  and  the  standardized  parameter  estimates  for 
the  independent  variables  on  the  first  variate  closely  resemble  those  of  the 
Independent  variables  in  predicting  solution  latency  alone  (see  Table  4). 

The  first  variate,  therefore,  seems  very  closely  to  resemble  solution  latency 
considered  in  Isolation  from  error  rate. 

The  second  canonical  variate  was  statistically  significant  only  for  the 
linguistic  model.  The  weights  for  the  dependent  variables  reveal  that  error 
rate  makes  a large  contribution  to  this  variate,  and  that  the  contribution  of 
solution  latency  is  negative.  This  negative  weight  suppresses  the  variance 
in  solution  latency  that  is  correlated  with  error  rate.  This  suppression  is 
needed  in  order  to  make  the  second  canonical  variate  orthogonal  to  the  first. 
The  second  canonical  variate,  then,  apparently  represents  that  part  of  error 
rate  that  is  orthogonal  to  solution  latency.  Linguistic  pivot  search,  which 
is  unique  to  the  linguistic  model,  makes  the  strongest  positive  contribution 
toward  the  prediction  of  this  variate. 

Full  canonical  model.  The  results  obtained  so  far  suggest  that  the 
mixed  model  is  best  in  predicting  solution  latencies  (which  are  represented 
by  the  first  canonical  variate),  and  that  the  linguistic  model  Is  best  in 
predicting  error  rates,  and  in  particular,  that  portion  of  error  rate  that  is 
uncorrelated  with  solution  latency  (which  is  represented  by  the  second  canoni- 
cal variate).  These  results  suggest  that  some  combination  of  the  nixed  and 
linguistic  models  may  give  a superior  account  of  solution  latency  and  error 
rate  considered  jointly  to  that  given  by  either  model  alone.  In  order  to 
Investigate  this  possibility,  a fully  exploratory  analysis  was  conducted  in 
which  a full  model  was  tested  that  included  all  parameters  of  the  three  models 
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previously  considered.  The  results  of  fitting  this  full  model  sre  shown 
In  Tsble  7. 


Insert  Table  7 about  here 
2 

The  value  of  canonical  R for  the  first  variate,  .858,  is  only  trivially 

2 

higher  than  that  value  of  canonical  R for  the  first  variate  when  the  mixed 

model  Is  fit  alone,  .849.  Even  combining  the  parameters  of  the  three  models, 

therefore,  one  can't  do  any  better  than  the  mixed  model  in  predicting  the 

2 

latency-based  first  variate.  The  value  of  canonical  R for  the  second  vari- 
ate, .432,  represents  a noticeable  increase  over  the  value  of  .268  for  the 
linguistic  model  alone.  As  In  the  linguistic  model  alone,  however,  the  lin- 
guistic pivot  search  parameter  appears  to  be  the  truly  powerful  predictor 
of  performance,  with  spatial  pivot  search  making  a secondary  contribution. 

Experience  with  canonical  regression  has  showed  that  the  standardized 
parameter  estimates  are  often  less  readily  interpretable  than  the  correlations 
of  the  original  variables  with  canonical  variate  scores  (see  Sternberg,  1977b). 
These  scores  are  computed  for  each  observation  simply  by  summing  the  product 
of  each  standardized  independent  or  dependent  variable  times  its  corresponding 
standardized  weight.  Correlations  between  the  canonical  variate  scores  and 
the  original  variables  are  presented  in  Table  8. 

Insert  Table  8 about  here 

Solution  latency  is  very  highly  correlated  with  both  the  dependent  and 
independent  variate  scores.  Error  rate  is  also  fairly  highly  correlated  with 
scores  on  the  first  variate.  This  pattern  of  correlations  is  to  be  expected 
if  error  rate  is  a less  precise  measure  than  solution  latency  of  whatever  it 
is  that  solution  latency  measures.  In  one  aspect,  therefore,  error  rate  is 
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am  Imperfect  substitute  for  solution  latency.  But  In  another  aspect,  error 
rate  measures  something  solution  latency  does  not  measure  (as  expressed  In 
the  second  canonical  variate).  This  pattern  is  not  unique  to  linear  syl- 
logisms: It  appears  for  analogies  as  veil  (Sternberg,  1977b). 

Turning  to  the  correlations  for  the  Independent  variables,  one  can  see 
that  all  of  the  Independent  variables  of  the  mixed  model  are  significantly 
correlated  with  both  the  dependent  and  Independent  variate  scores,  except 
In  one  Instance,  response  search.  Of  all  the  parametera,  only  linguistic 
pivot  search  shows  significant  and  substantial  correlations  with  both  the 
dependent  and  Independent  second  variate  scores.  Thus,  It  is  Indeed  this 
operation  that  is  responsible  for  the  superiority  of  the  linguistic  model 
In  accounting  for  error  rate. 

Discussion 

The  significant  correlation  of  the  linguistic  pivot  search  variable  with 
error  rate  but  not  solution  latency  Initially  seems  perplexing.  How  Is  It 
possible  for  a variable  to  contribute  to  error  rate  but  not  to  solution  latency? 

A plausible  explanation  (Schustack,  Note  2)  Is  that  the  linguistic  pivot 
search  operation  Is  always  executed,  but  It  takes  a constant  amount  of  time 
across  Item  types  and  hence  does  not  appear  as  a separate  latency  parameter. 

Instead,  Its  latency  Is  absorbed  into  the  global  constant  (used  in  the  models 
of  linear  syllogistic  reasoning  to  estimate  response  component  time).  By 
this  explanation,  subjects  always  compress  the  first  premise  of  a linear  syl- 
logism, and  later  retrieve  from  long-term  memory  the  term  that  was  temporarily 
deleted  from  working  memory.  However,  the  linguistic  pivot  search  operation 
leads  to  errors  in  solution  only  in  cases  where  the  term  that  Is  temporarily 
deleted  in  compression  Is  also  the  pivot  term.  In  these  cases,  an  error  in 
the  operation  will  result  in  selection  of  an  Incorrect  pivot,  and  hence  an 
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error  in  solution.  In  esses  where  the  temporarily  deleted  term  is  not  the 
pivot,  the  value  of  this  term  doesn't  lead  to  selection  of  an  erroneous  pivot, 
and  hence  doesn't  lead  to  an  error  lr.  solution. 

Subjects  are  generally  not  aware  of  the  pitfalls  posed  by  structural 
variables  that  contribute  differentially  to  error  rate  but  uniformly  to  solution 
latency.  Consider,  for  example,  a variant  of  a problem  that  is  a classic  in 
puzzle  books:  A plane  traveling  from  the  United  States  to  Canada  crashes 
directly  on  the  border  between  the  two  countries.  In  what  country  will  the 
survivors  be  buried?  Host  people  unfamiliar  with  the  problem  respond  quickly 
with  either  "the  United  States,"  "Canada,"  or  "either  country."  The  printed 
solution,  however,  will  usually  be  that  "survivors  aren't  buried"  (at  least, 
not  immediately)!  Suppose,  though,  the  problem  had  been  stated  in  this  way: 

A plane  traveling  from  the  United  States  to  Canada  crashed  directly  on  the 
border  between  the  two  countries.  In  what  country  will  the  deceased  be 
buried?  Readers  who  are  tripped  up  by  the  first  version  of  the  problem 
would  generally  encode  this  second  version  of  the  problem  in  the  same  way 
as  they  would  encode  the  first  version,  responding  in  approximately  the 
same  amount  of  time.  Yet,  they  would  be  far  more  likely  to  respond  with 
an  "acceptable"  answer  to  the  second  version.  Because  the  source  of  dif- 
ficulty in  the  first  version  of  the  problem  is  not  recognized  as  such,  it 
does  not  contribute  differentially  to  solution  latency.  The  true  nature 
of  the  problem  is  misapprehended.  Such  misapprehensions  are  common  in 
ability-testing  situations.  Subjects  who  score  relatively  poorly  may  per- 
ceive themselves  as  soorlng  well  because  they  solve  problems  that  are  dif- 
ferent from  and  easier  than  the  ones  actually  posed.  In  multiple-choice 
tests,  distractors  are  presented  that  capitalize  upon  the  subjects'  mis- 
apprehensions of  the  problems.  The  subjects  thus  never  become  aware  of 
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their  misapprehensions. 

The  results  of  the  present  experiment  show  the  Importance  of  modeling 
both  solution  latencies  and  error  rates  jointly  (Sternberg,  1977b)  as  veil 
as  separately  (Sternberg,  1977a,  1977b).  Pachella  (1974)  has  shown  that 
differential  error  rates  across  conditions  can  drastically  affect  interpre- 
tation of  latency  outcomes,  and  the  present  results  seem  to  indicate  that 
the  appearance  of  curious  conflicts  in  the  literature  can  arise  simply 
from  the  failure  to  consider  solution  latency  and  error  rate  as  conveying 
overlapping  but  by  no  means  identical  information.  The  conflict  resided 
not  in  the  data,  but  in  our  Inadequate  interpretations  of  them.  It  is 
tempting  in  research  on  reasoning  and  other  cognitive  processes  to  deal  with 
either  solution  latency  or  error  rate  to  the  exclusion  of  the  other.  Pev 
studies  give  serious  consideration  to  both.  Most  often,  the  inattention  to 
one  or  the  other  dependent  variable  is  not  justified;  sometimes,  it  is  justi- 
fied by  an  author's  pointing  to  the  high  correlation  between  latencies  and 
errors  across  conditions.  This  justification  is  unacceptable.  On  the  one 
hand,  interpretation  of  solution  latency  by  Itself  is  inadequate,  because 
the  unexplained  variance  in  error  rate  may  be  both  statistically  significant 
and  of  signal  importance  in  obtaining  a complete  understanding  of  the  prob- 
lem-solving process.  On  the  other  hand,  interpretation  of  error  rate  by 
itself  is  Inadequate,  because  error  rate  may  be  a complex  variable  comprising 
tvo  kinds  of  errors  that  can  be  disentangled  and  thereby  separately  understood 
only  in  the  context  of  solution  latency.  The  present  work  shows  this  com- 
plexity in  error  rates  for  linear  syllogism  problems,  and  previous  work 
shows  it  in  error  rates  for  the  only  other  kind  of  problem  that  has  been 
similarly  analyzed,  analogies  (Sternberg,  1977b).  Understanding  of  cognitive 
processes  seems  to  require  that  serious  attention  be  paid  to  both  latencies 
and  errors. 
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Appendix 

Observed  and  predicted  latencies  for  the  linear  syllogisms  are  shown  in 
Table  A.  A complete  listing  of  the  independent  variables  used  in  parameter 
estimation  can  be  found  in  Table  2 of  Sternberg  (Note  l).  The  listing  is 
available  upon  request.  Parameter  estimates  used  in  computing  predictions 
were  as  follows: 

Mixed  model : marking,  357  + 6U  msec;  negation,  127  +_ 70  msec;  pivot 
search,  796  + 168  msec;  response  search,  U85  +,  111  msec;  noncongruence,  1»37  +, 
119  msec;  encoding  + response,  1*600  msec.  (These  parameter  estimates  differ 
slightly  from  those  presented  in  Table  2 because  they  are  based  upon  only  the 
32  linear  syllogisms,  exclusive  of  the  8 two-term  series  problems.) 

Linguistic  model:  marking,  357  + 100  msec;  negation,  326  + 8j  msec; 
noncongruence,  636  + 173  msec;  linguistic  pivot  search,  186  +_  200  msec;  encoding 
+ response,  U696  msec. 

Spatial  model : marking,  357  +,  100  msec;  negation,  326  +_  86  msec;  premise 
order,  5 ± 173  msec;  spatial  pivot  search,  U65  + 122  msec;  encoding  + response, 
1*59^  msec. 

Insert  Table  A about  here 
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Footnotes 
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by  ONR  Contract  N0001478C0025  to  Robert  Sternberg.  The  research  vas  supported 
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be  sent  to  Robert  J.  Sternberg,  Department  of  Psychology,  Box  11A  Tale  Station, 
Tale  University,  New  Haven,  Connecticut  06520. 

*The  models  vere  fit  to  geometric  mean  latencies  Cor  32  data  points.  The 
quality  of  the  data  are  suspect,  hovever,  because  (a)  there  vere  only  13 
subjects,  vith  three  observations  per  subject,  (b)  the  longest  latency  for 
each  subject  for  each  item  (33Z  of  the  observations)  vas  discarded,  (c)  and 


error  responses  vere  also  discarded  (71  of  the  observations) . 

^Reliability  of  the  latency  data  for  the  three-term  series  problems 


computed  by  arbitrarily  dividing  the  subjects  into  two  halves,  correlating 
the  two  sets  of  latencies  across  the  32  item  types,  and  correcting  the  re- 
sulting correlation  by  the  Spearman-Brovn  formula. 

^Significance  of  the  residual  variance  vas  determined  by  computing 
residuals  of  the  observed  from  the  predicted  latencies  for  each  of  two  ar- 
bitrarily chosen  groups  of  subjects,  correlating  the  residuals,  and  correcting 
the  resulting  correlation  by  the  Spearman-Brovn  formula. 
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Table  1 

Quantitative  Fits  of  the  Models  to  the  Latency  Data 


Data  Set 

Item 

X 

Latencies 

®X 

Mixed 

R?  for  Model 
Linguistic 

Spatial 

3-Term  Series 

All  Adjectives 

5922 

128 

.81*3** 

.592** 

.606** 

Taller-Shorter 

5821* 

138 

.690** 

.528** 

.563** 

Better-Worse 

596U 

139 

.692** 

.1*68** 

.396** 

Faster-Slover 

5961* 

153 

.683** 

.586** 

.576** 

2-  & 3-Term  Series 

All  Adjectives 

521*5 

21*0 

.966” 

.921** 

.921*** 

Note:  Response  latencies  are  presented  in  msec. 

•*£  <.01 
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Table  2 

Latency  Parameter  Estimates  for  Present  Experiment 
and  Two  Previous  Experiments: 

Mixed  Model 

Estimated  Latency 


Latency  Parameter 

Speed  Emphasis 

Present  Experiment 

Accuracy  Emphasis 
Experiment  3*  Experiment  l»a 

Encoding 

1351*** 

2986** 

312lt** 

- 

(70) 

(18M 

(152) 

Negation 

11*3* 

181** 

21*1*  •• 

(65) 

(86) 

(71) 

Marking 

327** 

307** 

380** 

(58) 

(73) 

(63) 

Pivot  Search 

788** 

1151*** 

1003»* 

(159) 

(226) 

(17U) 

Response  Search 

1485** 

522** 

656** 

(108) 

(163) 

(118) 

Noncongruence 

395** 

538** 

396** 

(102) 

(119) 

(111) 

Response 

19M 

2517 

2353 

Note:  Standard  errors  of  parameter  estimates  are  shown  in  parentheses  below  the 
appropriate  estimates.  All  latencies  are  in  msec. 

aData  from  Sternberg  (Note  l) 


r 


1 
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Table  3 

Quantitative  Fits  of  the  Models  to  the  Error  Data 
Partitioned  by  Pseudo-Deadlines 


p 

Pseudo-Deadline  Proportion  of  Errors  R for  Model 


sec) 

X 

sx 

Mixed 

Linguistic 

Spatial 

2 

.998 

.001 

.053 

.031 

.027 

4 

• 7T9 

.018 

.774** 

.487** 

.419** 

6 

.432 

.021 

.722** 

.576** 

.47 6** 

8 

.222 

.018 

.804** 

.652** 

.687** 

10 

.131 

.012 

.454** 

*493** 

.417** 

12 

.098 

.009 

.440** 

.428** 

.417** 

14 

.030 

.009 

.395** 

.446** 

.405** 

16 

.07  6 

.009 

.334* 

.407** 

.339** 

m 

.069 

.008 

.263 

.387** 

.276 

Note:  Model  fits  are  for  three-term  series,  all  adjectives  combined. 

*£  05 

**£  <.01 
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Table  1* 

Standardized  Parameter  Estimates  for  Error  Data  Partitioned 
by  Pseudo-Deadlines  and  for  Latency  Data 


Mixed  Model 


Marking 

Negation 

Mixed  Pivot 

Noneon- 

Response 

Search 

gruence 

Search 

Pseudo-Deadline 

(sec) 

2 

-.06 

.20 

-.16 

-.06 

.11 

* 

.UO** 

.16 

.U0»* 

.25** 

.U8** 

6 

.U3** 

.20 

.29* 

.32** 

.UU** 

8 

.52** 

.03 

.U5*» 

.37** 

.28** 

10 

.U8** 

.01 

.23 

.29** 

.23 

12 

.1*1** 

-.16 

• 33* 

.29* 

.23 

lU 

.1*3** 

-.19 

.26 

.30* 

.17 

16 

.1*2** 

-.20 

.26 

.23 

.16 

- 

.38* 

-.15 

.12 

.23 

.19 

Latencies 

.1*3** 

.18* 

.U8»* 

.31** 

.3U** 

Linguistic  Model 

Marking 

Negation 

Linguistic 

Noncon- 

f 

Pivot  Search 

gruence 

Pseudo-Deadline 

(sec ) 

2 

-.06 

.11 

-.06 

-.11 

U 

.UO** 

.39** 

.19 

.37** 

6 

.U3*» 

.36** 

.31** 

• U0** 

8 

.52** 

.29** 

.21* 

.50** 

10 

.U8** 

.lU 

.36** 

.35** 

12 

.Ul** 

.03 

.33* 

.39** 

lU 

.U3** 

-.03 

.35* 

.38** 

1 6 

.U2** 

-.05 

.38** 

.30* 

.38** 

-.09 

.Ul** 

.26* 

» Latencies 

.U3** 

.U6*» 

.11 

.UU** 
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Table  1*  Continued 


Spatial  Model 


Marking 

Pseudo-Deadline 

(sec) 

Negation 

Spatial  Pivot 

Search 

Premise 

2 

-.06 

.11 

.00 

.11 

.UO** 

.39” 

.32* 

-.06 

6 

.1*3” 

.36” 

.37** 

.li* 

8 

.52” 

.29” 

.57** 

.00 

10 

.1*8” 

.11* 

.1*1” 

.oi* 

12 

.Ul” 

.03 

.1*8” 

.10 

Ik 

.1*3” 

-.03 

.1*7” 

.06 

16 

.1*2” 

-.05 

.39” 

.09 

m 

.38* 

-.09 

.33* 

.11 

Latencies 

.1*3” 

.1*6** 

.1*6” 

.00 

Note:  Model  fits  are  for  three-term  series,  all  adjectives  combined. 

*£  <-05 

•*£  <.01 
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Table  5 

Quantitative  Fits  of  the  Models  to  the  Latency  Data 
Partitioned  by  Pseudo-Deadlines 


Item 

Lat'.nries 

B2  for  Model 

a 

3 -Deadline 

X 

&X* 

n 

Mixed 

Lin^iistic 

Spatial 

f \ 

[sec ) 

Latent 

es  abo 

V'_  Pseudo- 

-Deadline 

2 

5930 

129 

32 

.81*6** 

.607** 

.6o6** 

It 

6630 

91 

32 

.680** 

.51*6** 

.591** 

6 

8321 

121* 

32 

. 1*52** 

.339** 

.1*35** 

8 

lOltllt 

160 

32 

.081 

.066 

.051* 

10 

12912 

508 

30 

.271 

.122 

.203 

12 

11*937 

581* 

25 

.2-7 

.225 

.238 

lU 

177U0 

592 

13 

.367 

.280 

.060 

16 

19122 

538 

10 

0 

.221* 

.1*00 

.11*1 

Latencies  belov  Pseudo- 

-Deadline 

£ 

It 

3332 

30 

V 

32 

.1*51*** 

.356* 

.377* 

6 

1*356 

1*6 

32 

.711** 

.378* 

.1*21*** 

8 

5038 

63 

32 

.71*7** 

.1*88** 

.1*00** 

10 

51*31* 

91 

32 

.81*  it** 

.585** 

.551** 

12 

561*  U 

103 

32 

.82lt»* 

.61*3** 

.577** 

lit 

5776 

112 

32 

.795** 

.593** 

.51*5** 

16 

5813 

117 

32 

.793** 

.597** 

.555** 

m 

5922 

128 

32 

.81*3** 

.592** 

.606** 
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Table  5 Continued 


»ot.e:  All  l-teneie.  .re  e*pres,ed  in  m..c  Moaeli„8  va»  of  the  32  three-tei® 
series  item  types. 

"IL  refers  to  number  of  item  types  (out  of  32)  for  which  there  were  any  observations 
(nonmissing  data)  above  or  below  pseudo-deadline. 

*£  <-05 

**£  <.01 
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Table  6 

Quantitative  Fits  and  Standardized  Parameter  Estimates  of  the  Canonical  Models 

to  the  Latency  and  Error  Data 

Variate 


1 

2 

2 

Canonical  R 

Mixed  Model 

,8U9#* 

.lh2 

Linguistic  Model 

.632** 

.268* 

Spatial  Model 

.622** 

.160 

Standardized  Parameter  Estimates  for  Dependent  Variables 


Mixed  Model 
Latency 
Error  Rate 
Linguistic  Model 
Latency 
Error  Rate 
Spatial  Model 
Latency 
Error  Rate 


96 

10 


87 

-.60 

29 

1.02 

92 

20 

— 
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Table  6 Continued 


Variate 
1 2 

Standardized  Parameter  Estimates  for  Independent  Variables 


Mixed  Model 


Marking 

.1*9 

— 

Negation 

.IT 

— 

Pivot  Search  (Mixed) 

.52 

— 

Noncongruence 

• 3U 

— 

Response  Search 

.37 

— 

Linguistic  Model 

Marking 

.61 

-3 

CM 

• 

Negation 

.U7 

-.70 

Pivot  Search  (Linguistic) 

.27 

.67 

Noncongruence 

.58 

-.01 

Spatial  Model 

Marking 

.60 

— 

Negation 

.51 

— 

Pivot  Search  (Spatial) 

.62 

— 

Premise  Order 

.03 

Note:  All  model  fitting  was  done  on  the  32  three-term  series  item  types, 
•fc  <.05 
•*£  <.01 
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Table  7 

Quantitative  Fit  and  Standardised  Parameter  Estimates  of  the  Full  Canonical  Model 

to  the  Latency  and  Error  Data 


Variate 
1 2 

2 

Canonical  R 


Full  Model 

. 858** 

.432* 

Standardized  Parameter  Estimates  for  Dependent  Variables 

Latency 

• 94 

-.45 

Error  Rate 

.15 

1.05 

Standardized  Parameter  Estimates 

1 for  Independent  Variables 

Marking 

.50 

.29 

Negation 

.20 

.04 

Mixed  Pivot  Search 

.1*3 

-.88 

Response  Search 

.37 

.05 

Noncongruence 

.25 

-.10 

Linguistic  Pivot  Search 

.04 

.86 

Premise  Order 

.02 

.17 

Spatial  Pivfct  Search 

.17 

.62 

Note:  All  model  fitting  was  done  on  the  32  three-term  series  item  types. 
#£  <-05 
•»£  <.01 
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Table  8 

Correlations  of  Canonical  Variate  Scores  with  Original  Variables 


Original  Variable  Variate  1 Variate  2 


Dependent 

Independent 

Dependent 

Independent 

Dependent 

Latency 

. 99 *** 

.92*** 

-.11* 

-.09 

: Error  Rate 

.1*5** 

.1*2** 

.89*** 

.59*** 

Independent 

Marking 

• U6** 

.50** 

.19 

.29 

Negation 

.1*2** 

.1*5** 

-.31 

-.1*7** 

Mixed  Pivot  Search 

.65*** 

.70*** 

-.23 

-.31* 

Response  Search 

.35 

.37* 

• 03 

.05 

Noncongruence 

.1*6** 

.1*9** 

.06 

.09 

Linguistic  Pivot  Search 

.17 

.18 

.37* 

.57*** 

Premise  Order 

.02 

.02 

.11 

.17 

Spatial  Pivot  Search 

.1*8*» 

.52** 

.13 

.19 

*£  <-05 
**£  <.01 
••*£  <.001 
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Table  A 

Observed  and  Predicted  Latencies  for  Linear  Syllogisms 


Item  No. 


Observed  Latency 


Predicted  Latencies 

Mixed  Model  Linguistic  Model  Spatial  Model 


1 

00001 

5223 

5085 

1*882 

5059 

2 

00100 

5096 

5391* 

5875 

51*16 

3 

00000 

1*630 

1*600 

1*696 

5061* 

1* 

00101 

5568 

5878 

5689 

51*21 

5 

11000 

5l*8l 

5750 

6232 

5778 

6 

11101 

6337 

6155 

5953 

6135 

7 

11001 

6159 

6235 

601*6 

5773 

8 

11100 

5888 

5670 

5767 

6130 

9 

01001 

518U 

51*1*2 

5053 

1*951 

10 

01100 

1*927 

5313 

51*10 

5308 

11 

10000 

5581 

1*957 

5053 

1*956 

12 

10101 

5601 

5798 

51*10 

5313 

13 

10001 

6296 

5878 

5689 

5881 

ll* 

10100 

5991 

5750 

601*6 

6238 

15 

01000 

5231* 

5391* 

5689 

5886 

16 

01101 

6336 

6235 

60l»6 

621*3 

17 

11011 

6860 

61*88 

6698 

61*25 

18 

lino 

51*52 

5923 

61*19 

6782 

19 

noio 

7219 

6800 

6881* 

61*30 

20 

mil 

7110 

7201* 

6605 

6787 

21 

00010 

5080 

1*853 

531*8 

5716 

22 

00111 

5719 

6132 

631*1 

6073 

23 

00011 

5835 

6135 

5531* 

5711 

2k 

oono 

6188 

61*1*3 

6527 

6068 

25 

loon 

71*06 

6928 

631*1 

6533 

26 

lono 

6901* 

6800 

6698 

6890 

27 

01010 

6308 

61*1*3 

631*1 

6538 

28 

onn 

7067 

7285 

6698 

6895 

29 

oion 

5635 

5695 

5705 

5603 
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Table  A Continued 


Item  No. 

Codea 

Observed  Latency 

Predicted  Latencies 

Mixed  Model 

Linguistic  Model 

Spatial  Model 

30 

OHIO 

566U 

5267 

6062 

5960 

31 

10010 

5222 

5210 

5705 

5608 

32 

10111 

6288 

6051 

6062 

5965 

RMSD 

292 

1*1*9 

1*1*9 

Note:  All  latencies  are  presented  in  msec. 


^ive-digit  code  represents  item  type.  For  code  abode, 

a — First  premise  adjective  marked?  (0=no,  l=yes) 
b — Second  premise  adjective  marked?  (0=no,  l=yes ) 
c — Question  adjective  marked?  (0=no,  l=yes) 
d — Premises  negated?  (0=no,  l*yes) 
e — Answer  to  problem  in  first  premise?  (0=no,  l=yes) 


Technical  Report.  Presently  In  this  Series 
HR  ISO-412,  ONR  Contract  N0001478C0025 


#l*  Stern^8.  R-  Intelligence  research  at  the  Interface 

cosMtl«  Protect, 


•2.  Sternberg,  R.  J.  Ieoleetng  the  component;  of  Intelligence.  January,  1978. 
January j 1978?1”"’"’  M‘  J"  * Tun,,r'  M-  E-  Deductive  reeeonlne. 

Tbssr d a unifijd  componentul  theory  of  hujjn  reeoonlne. 

#5‘  Curoc:^±:  rP;iu'mS*- j-  * ^ ^ „n.,tot»c 

Sternberg,  R.^J.,  (,  Turner.  M.  E.  Conjonento  of  aylloglatle  reeoonlne. 

|5||i  f 

#9.  Sternberg.  R.  J.  The  njtur.  of  nemnl  ebllltlee.  Ju„e,  1978. 

#1°-  stens^i  msmm sate  'g^ss  - 

#11.  Tourangeau,  R.t  & Sternberg,  R.  J.  Understanding  and  appreciating 
metaphors.  June,  1978.  ^ 
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Air  Force  Human  Resources  Lab 
afhrl/ped 

Brooks  AFB,  TX  78235 

Air  University  Library 
AUL/LSE  76/443 
Maxwell  AFE,  AL  36112 

DR.  G.  A.  ECKSTRAND 
AFHRL/AS 

VRIGHT-PATTERSON  AFB,  OH  45433 

Dr.  Alfred  R.  Fregly 
AFOSR/NL,  Bldg.  410 
Bolling  AFB,  DC  20332 

CDR.  MERCER 
CNET  LIAISON  OFFICER 
AFHRL/FLYING  TRAINING  DIV. 
WILLIAMS  AFE,  AZ  85224 

Personnel  Analysis  Division 
HQ  USAF/DPXXA 
Washington,  DC  20330 

Research  Branch 
AFMPC/DPMYP 

Randolph  AFB,  TX  78148 

Dr.  Marty  Rockway  (AFHRL/TT) 

Lowry  AFB 
Colorado  80230 

Major  Wayne  S.  Sellman 
Chief,  Personnel  Testing 
AFMPC/DPKYPT 
Randolph  AFB,  TX  78148 

Brian  K.  Waters,  Maj.,  USAF 
Chief,  Instructional  Tech.  Branch 
AFHRL 

Lowry  AFB,  CO  80230 


1 Director,  Office  of  Manpower  Utilization 
HQ,  Marine  Corps  (KPU) 

BCB,  Bldg.  2009 
Quantico,  VA  22134 

1 DR.  A.L.  SLAFK0SKY 

SCIENTIFIC  ADVISOR  (CODE  RD-1) 

HQ,  U.S.  MARINE  CORPS  , 

WASHINGTON,  DC  20380 
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CoastCuard 


MR.  JOSEPH  J.  COWAN,  CHIEF 
PSYCHOLOGIC;!  RESEARCH  (G-P 
U.S.  COAST  G-JARD  HO 
WASHINGTON,  LC  20590 
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Other  DoD 


1 Dr.  Stephen  Andriole 

-1/62)  ADVANCED  RESEARCH  PROJECTS  AGENCY 

U00  WILSON  ELVD. 

ARLINGTON,  VA  22209 

12  Defense  Documentation  Center 
Cameron  Station,  Bldg.  5 
Alexandria,  VA  2251** 

Attn:  TC 

1 Dr.  Dexter  Fletcher 

ADVANCED  RESEARCH  PROJECTS  AGENCY 
1*00  WILSON  ELVD. 

ARLINGTON,  VA  22209 

1 Military  Assistant  for  Human  Resources 
Office  of  the  Director  of  Defense 
Research  & Engineering 
Room  3D129,  the  Pentagon 
Washington,  DC  20301 

1 Director,  Research  & Data 
OSD/MRA&L  (Ra.  3&919) 

The  Pentagon 
Washington,  DC  20301 

1 Mr.  Fredrick  W.  Suffa 
MPP  (A&R) 

2B269 

Pentagon 

Washington,  D.C.  20301 
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Civil  Govt 


Dr.  Susan  Chipman 
Basic  Skills  Program 
National  Institute  of  Education 
1200  19th  Street  NW 
Washington,  DC  20208 

Dr.  William  Gorham,  Director 
Personnel  R&D  Center 
D.S.  Civil  Service  Commission 
1900  E Street  NW 
Washington,  DC  20*115 

Dr.  Andrew  R.  Molnar 
Science  Education  Dev. 

•nd  Research 

National  Science  Foundation 
Washington,  DC  20550 

Dr.  Thomas  C.  Sticht 
Basic  Skills  Program 
National  Institute  of  Education 
•200  19th  Street  NW 
Washington,  DC  20208 

Dr.  Joseph  L.  Young,  Director 
Memory  & Cognitive  Processes 
National  Science  Foundation 
Washington,  DC  20550 


Non  Govt 


1 PROF.  EARL  A.  ALLUISI 
DEPT.  OF  PSYCHOLOGY 
CODE  287 

OLD  DOMINION  UNIVERSITY 
NORFOLK,  VA  23508 

1 DR.  MICHAEL  ATWOOD 

SCIENCE  APPLICATIONS  INSTITUTE 
*10  DENVER  TECH.  CENTER  WEST 
7935  E.  PRENTICE  AVENUE 
ENGLEWOOD,  CO  80110 

1 1 psychological  research  unit 

Dept,  of  Defense  (Army  Office) 
Campbell  Park  Offices 
Canberra  ACT  2600,  Australia 

1 MR.  SAMUEL  BALL 

EDUCATIONAL  TESTING  SERVICE 
PRINCETON,  NJ  O35**0 

1 Dr.  Nicholas  A.  Bond 
Dept,  of  Psychology 
Sacramento  State  College 
600  Jay  Street 
Sacramento,  CA  95819 

1 Dr.  John  Seeley  Erown 

Bolt  Beranek  & Newman,  Inc. 

50  Moulton  Street 
Cambridge,  MA  02138 

1 Dr.  John  B.  Carroll 
Psychometric  Lab 
Univ.  of  No.  Carolina 
Davie  Hall  013A 
Chapel  Hill,  NC  2751*1 

1 Dr.  William  Chase 

Department  of  Psychology 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213 

1 Dr.  Michel ine  Chi 

Learning  R&D  Center 
University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15213 
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Non  Govt 


Dr.  Kenneth  E.  Clark 
College  of  Arts  & Sciences 
University  of  Rochester 
River  Campus  Station 
Rochester,  NY  11)627 

Dr.  Norman  Cliff 
Dept,  of  Psychology 
Univ.  of  So.  California 
University  Park 
Los  Angeles,  CA  90007 

Dr.  Allan  M.  Collins 
Bolt  Beranek  & Newman,  Inc. 

50  Moulton  Street 
Cambridge,  Ma  02138 

Dr.  Meredith  Crawford 
5605  Montgomery  Street 
Chevy  Chase,  MD  20015 

Dr.  Donald  Dansereau 
Dept,  of  Psychology 
Texas  Christian  University 
Fort  Worth,  TX  76129 

DR.  RENE  V.  DAVIS 
DEPT.  OF  PSYCHOLOGY 
UNIV.  OF  MINNESOTA 
75  E.  RIVER  RD. 

MINNEAPOLIS,  MN  55455 

Dr.  Ruth  Day 

Center  for  Advanced  Study 
in  Behavioral  Sciences 
202  Junipero  Serra  Elvd. 

Stanford,  CA  9^305 

ERIC  Facility-Acquisitions 
4833  Rugby  Avenue 
Bethesda,  MD  20011) 

MAJOR  I.  N.  EV0NIC 

CANADIAN  FORCES  PERS.  APPLIED  RESEARCH 
t 1107  AVENUE  ROAD 

TORONTO,  ONTARIO,  CANADA 


Non  Govt 


1 Dr.  Richard  L.  Ferguson 

The  American  College  Testing  Program 
P.0.  Box  168 
Iowa  City,  ZA  52240 

1 Dr.  Victor  Fields 
Dept,  of  Psychology 
Montgomery  College 
Rockville,  MD  .20850 

1 Dr.  Edwin  A.  Fleishman 

Advanced  Research  Resources  Organ. 
8555  Sixteenth  Street 
Silver  Spring,  MD  20910 

1 Dr.  John  R.  Frederiksen 
Bolt  Beranek  & Newman 
50  Moulton  Street 
Cambridge,  MA  02138 

1 DR.  ROBERT  GLASER 
LRDC 

UNIVERSITY  OF  PITTSBURGH 
3939  O’HARA  STREET 
PITTSBURGH,  PA  15213 

1 DR.  JAMES  G.  GREEN0 
LRDC 

UNIVERSITY  OF  PITTSBURGH 
3939  O'HARA  STREET 
PITTSBURGH,  PA  15213 

1 Dr.  Ron  Hambleton 
School  of  Education 
University  of  Massachusetts 
Amherst,  MA  01002 

1 Dr.  Barbara  Hayes-Roth 
The  Rand  Corporation 
1700  Main  Street 
Santa  Monica,  CA  901)06 

1 HumRRO/Ft.  Knox  office 
P.0.  Box  293 
Ft.  Knox,  KY  40121 
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Non  Govt 


Library 

HumRRO/Western  Division 
27857  Berwick  Drive 
Carmel,  CA  93921 

Dr.  Earl  Hunt 
Dept,  of  Psychology 
University  of  Washington 
Seattle,  WA  98105 

Mr.  Gary  Irving 
Data  Sciences  Division 
Technology  Services  Corporation 
2811  Wilshire  Blvd. 

Santa  Monica  CA  90403 

Dr.  Roger  A.  Kaufman 
203  Dodd  Hall 
Florida  State  Univ. 

Tallahassee,  FL  32306 

Dr.  Steven  W.  Keele 
Dept,  of  Psychology 
University  of  Oregon 
Eugene,  OR  97403 

Mr.  Marlin  Kroger 
1117  Via  Goleta 

Palos  Verdes  Estates,  CA  90274 

LCOL.  C.R.J.  LAFLEUR 
PERSONNEL  APPLIED  RESEARCH 
NATIONAL  DEFENSE  HCS 
101  COLONEL  EY  DRIVE 
OTTAWA,  CANADA  K1A  0K2 

Dr.  Frederick  M.  Lord 
Educational  Testing  Service 
Princeton,  NJ  08540 

Dr.  Robert  R.  Kackie 
Human  Factors  Research,  Inc. 
6780  Cortona  Drive 
Santa  Barbara  Research  Pk. 
Goleta,  CA  92017 


IBIS 

raou 


Non  Govt 


1 Dr.  Richard  E.  Mlllward 
Dept,  of  Psychology 
Hunter  Lab. 

Brown  University 
Providence,  RI  82912 

1 Dr.  Donald  A Norman 

Dept,  of  Psychology  C-009 
Univ.  of  California,  San  Diego 
La  Jolla,  CA  92093 

1 Dr.  Melvin  R.  Novick 
Iowa  Testing  Programs 
University  of  Iowa 
Iowa  City,  IA  52242 

1 Dr.  Jesse  Orlansky 

Institute  for  Defense  Analysis 
400  Army  Navy  Drive 
Arlington,  VA  22202 

1 Dr.  Seymour  A.  Pa pert 

Massachusetts  Institute  of  Technology 
Artificial  Intelligence  Lab 
545  Technology  Square 
Cambridge,  HA  02139 

1 MR.  LUIGI  PETRULLO 

2431  N.  EDGEW00D  STREET 
ARLINGTON,  VA  22207 

1 DR.  PETER  P0LS0N 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  COLORADO 
BOULDER,  CO  80302 

1 Dr.  Frank  Pratzner 

Cntr.  for  Vocational  Education 
Ohio  State  University 
I960  Kenny  Road 
Columbus,  OH  43210 

1 DR.  DIANE  M.  RAMSEY-KLEE 

F-K  RESEARCH  & SYSTEM  DESIGN 
3947  RIDGEM0NT  DRIVE 
MALIBU,  CA  90265 


IS  BSST  QUALITY  PRACTICABI^ 
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Non  Govt 


MIN.  RET.  M.  RAUCH 
P II  *4 

BUNDESMINISTERIUM  DER  VERTEIDIGUNC 
POSTFACH  161 
53  BONN  1.  GERMANY 


Mon  Govt 


1 Dr.  Robert  Singer,  Director 
Motor  Learning  Research  Lab 
Florida  State  University 
212  Montgomery  Gya 
Tallahassee,  FL  32306 


Dr.  Mark  D.  Reckase 
Educational  Psychology  Dept. 
University  of  Missouri-Columbia 
12  Hill  Hall 
Columbia,  MO  65201 

Dr.  Joseph  W.  Rigney 
Univ.  of  So.  California 
Behavioral  Technology  Labs 
3717  South  Hope  Street 
Los  Angeles,  CA  90007 

Dr.  Andrew  M.  Rose 
American  Institutes  for  Research 
1055  Thomas  Jefferson  St.  NV,' 
Washington,  DC  20007 

Dr.  Leonard  L.  Rosenbaum,  Chairman 
Department  of  Psychology 
Montgomery  College 
Rockville,  KD  20850 

Dr.  Ernst  Z.  Rothkopf 
Bell  Laboratories 
600  Mountain  Avenue 
Murray  Hill,  NJ  0797*4 

PROF.  FUKIKO  SAMEJIMA 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  TENNESSEE 
KNOXVILLE,  TN  37916 

DR.  WALTER  SCHNEIDER 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  ILLINOIS 
CHAMPAIGN,  IL  61820 

DR.  ROBERT  J.  SEIDEL 
INSTRUCTIONAL  TECHNOLOGY  GROUP 
HUMRRO 

300  N.  WASHINGTON  ST. 

ALEXANDRIA,  VA  22?U 


1 Dr.  Richard  Snow 
School  of  Education 
Stanford  University 
Stanford,  CA  9*4305 

1 DR.  ALBERT  STEVENS 

BOLT  BERANEK  & NEWMAN,  INC. 

50  MOULTON  STREET 
CAMBRIDGE,  MA  02138 

1 DR.  PATRICK  SUPPES 

INSTITUTE  FOR  MATHEMATICAL  STUDIES  IN 
THE  SOCIAL  SCIENCES 
STANFORD  UNIVERSITY 
STANFORD,  CA  9*4305 

1 Dr.  Kikumi  Tatsuoka 

Computer  Based  Education  Research 
Laboratory 

252  Engineering  Research  Laboratory 
University  of  Illinois 
Urbana,  IL  61801 

1 DR.  PERRY  THORNDYKE 
THE  RAND  CORPORATION 
1700  MAIN  STREET 
SANTA  MONICA,  CA  90*106 

1 Dr.  Benton  J.  Underwood 
Dept,  of  Psychology 
Northwestern  University 
Evanston,  IL  60201 

1 DR.  THOMAS  VALLSTEN 

PSYCHOMETRIC  LABORATORY 
DAVIE  HALL  01 3A 
UNIVERSITY  OF  NORTH  CAROLINA 
CHAPEL  HILL,  NC  2751*4 

1 Dr.  Claire  E.  Weinstein 

Educational  Psychology  Dept. 

Univ.  of  Texas  at  Austin 
Austin,  TX  78712 
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Dr.  David  J.  Weiss 
N660  Elliott  Hall 
University  of  Minnesota 
75  E.  River  Road 
Minneapolis,  MN  55^55 

DR.  SUSAN  E.  WHITELY 
PSYCHOLOGY  DEPARTMENT 
UNIVERSITY  OF  KANSAS 
LAWRENCE,  KANSAS  660HH 
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Additions  to  Distribution  list: 


LT  Steven  D.  Harris,  MSC,  USN 
Naval  Aeros^ce  Medical  Research  Lab 
NAS,  Pensacola,  FL  32508 


Dr.  Fred  Reif 
SESAME 

University  of  California 
Berkeley,  CA  94720 


Dr.  Robert  Breaux 

Human  Factors  lab 

Naval  Training  Equipment  Center 

Code  N-215 

Orlando,  a 32813 


